Imaging method for image sensor, imaging apparatus, and electronic device

ABSTRACT

The present disclosure provides an imaging method for an image sensor, an imaging apparatus and an electronic device. The image sensor includes a photosensitive pixel array and a filter arranged on the photosensitive pixel array. The filter includes an array of filter units. Each filter unit and a number of adjacent photosensitive pixels covered by the filter unit in the photosensitive pixel array form a synthesized pixel. The method includes: reading an output of the photosensitive pixel array, extracting pixel values of photosensitive pixels within different synthesized pixels from a read-out single-frame high-resolution image, and combining the pixel values so as to obtain a number of multi-frame low-resolution images; synthesizing the number of multi-frame low-resolution images.

CROSS REFERENCE TO RELATED APPLICATIONS

This application is a US national application of an InternationalApplication No. PCT/CN2016/100649, filed on Sep. 28, 2016, which claimsa priority to Chinese Patent Application Serial No. 201510963341.3,filed with the State Intellectual Property Office of P. R. China on Dec.18, 2015 by GUANGDONG OPPO MOBILE TELECOMMUNICATIONS CORP., LTD., andtitled with “imaging method for image sensor, imaging apparatus andelectronic device”, the entire contents of which are incorporated hereinby reference.

TECHNICAL FIELD

The present disclosure relates to the imaging technology field, and moreparticularly, to an imaging method for an image sensor, an imagingapparatus and an electronic device.

BACKGROUND

At present, diversification of camera functions of mobile phones hasearned trust of users. Multi-frame synthesis technology is applied inmany mobile phones when photographing, i.e. an image sensor of themobile phone continuously captures a plurality of images, and then theimages are synthesized by software so as to achieve differentphotography effects (such as a High Dynamic Range (HDR for short)effect, a night effect, etc.) to enrich use experience.

However, in the multi-frame synthesis technology used in related art,due to a need of acquiring the multi-frame data, long time is requiredfor the multi-frame data. In addition, if an object to be photographedis moving when capturing the multi-frame data, ghosting effect occurseasily after synthesis.

SUMMARY

The present disclosure aims to solve at least one of the problems inrelated art to some extent. Accordingly, a first objective of thepresent disclosure is to provide an imaging method for an image sensor.

A second objective of the present disclosure is to provide an imagingapparatus.

A third objective of the present disclosure is to provide an electronicdevice.

A fourth objective of the present disclosure is to provide a mobileterminal.

A fifth objective of the present disclosure is to provide anon-transitory computer-readable storage medium.

In order to achieve the above objectives, a first aspect of embodimentsof the present disclosure provides an imaging method for an imagesensor. The image sensor includes a photosensitive pixel array and afilter arranged on the photosensitive pixel array. The filter includesan array of filter units. Each filter unit and a plurality of adjacentphotosensitive pixels covered by the filter unit in the photosensitivepixel array form a synthesized pixel. The imaging method includes:reading an output of the photosensitive pixel array, and extractingpixel values of photosensitive pixels within different synthesizedpixels from a read-out single-frame high-resolution image, and combiningthe pixel values so as to obtain a plurality of multiple-framelow-resolution images; and synthesizing the plurality of multiple-framelow-resolution images.

A second aspect of embodiments of the present disclosure provides animaging apparatus including an image sensor and an imaging processingmodule. The image sensor includes a photosensitive pixel array; a filterarranged on the photosensitive pixel array, the filter includes an arrayof filter units, each filter unit and a plurality of adjacentphotosensitive pixels covered by the filter unit in the photosensitivepixel array form a synthesized pixel. The image processing module isconnected to the image sensor, the imaging processing module isconfigured to read an output of the photosensitive pixel array, and isconfigured to extract pixel values of photosensitive pixels withindifferent synthesized pixels from a read-out single-framehigh-resolution image, and is configured to combine the pixel values soas to obtain a plurality of multi-frame low-resolution images, and isconfigured to synthesize the plurality of multi-frame low-resolutionimages.

A third aspect of embodiments of the present disclosure provides anelectronic device. The electronic device includes the imaging apparatusaccording to the second aspect of embodiments of the present disclosure.

A fourth aspect of embodiments of the present disclosure provides amobile terminal. The mobile terminal includes a housing; a processor; amemory; a circuit board; a power supply circuit and an image sensor. Thecircuit board is located in a space defined by the housing. Theprocessor, the memory and the image sensor are arranged on the circuitboard. The power supply circuit is configured to supply power for eachcircuit or component in the mobile terminal. The image sensor includes aphotosensitive pixel array and a filter arranged on the photosensitivepixel array. The filter includes an array of filter units. Each filterunit and a plurality of adjacent photosensitive pixels covered by thefilter unit in the photosensitive pixel array form a synthesized pixel.The memory is configured to store executable program codes. Theprocessor is configured to run a program corresponding to the executableprogram codes by executing the executable program codes stored in thememory so as to perform the following steps: reading an output of thephotosensitive pixel array, extracting pixel values of photosensitivepixels within different synthesized pixels from a read-out single-framehigh-resolution image, and combining the pixel values so as to obtain aplurality of multiple-frame low-resolution images; and synthesizing theplurality of multiple-frame low-resolution images.

A fifth aspect of embodiments of the present disclosure provides anon-volatile computer storage medium having one or more programs storedtherein. When one or more programs are executed by a device, the devicecan be configured to perform the imaging method for an image sensoraccording to the first aspect of embodiments of the present disclosure.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1A is a flow chart showing an imaging method for an image sensoraccording to an embodiment of the present disclosure.

FIG. 1B is a flow chart showing an imaging method for an image sensoraccording to a specific embodiment of the present disclosure.

FIG. 1C is a flow chart showing an imaging method for an image sensoraccording to a specific embodiment of the present disclosure.

FIG. 2 is a schematic diagram illustrating the obtaining of a pluralityof low-resolution image frames according to a specific embodiment of thepresent disclosure.

FIG. 3 is a block diagram showing an imaging apparatus according to anembodiment of the present disclosure.

FIG. 4A is a schematic diagram illustrating an array of filter unitsaccording to an embodiment of the present disclosure.

FIG. 4B is a schematic diagram illustrating a structure of an imagesensor according to an embodiment of the present disclosure.

FIG. 4C is a schematic diagram illustrating a structure of an imagesensor according to another embodiment of the present disclosure.

FIG. 5 is a schematic diagram illustrating a photosensitive pixel and arelated circuit according to an embodiment of the present disclosure.

FIG. 6 is a block diagram of a mobile terminal according to anembodiment of the present disclosure.

DETAILED DESCRIPTION

Reference will now be made in detail to embodiments of the presentdisclosure. Embodiments of the present disclosure will be shown indrawings, in which the same or similar elements and the elements havingsame or similar functions are denoted by like reference numeralsthroughout the descriptions. The embodiments described herein accordingto drawings are explanatory and illustrative and used to generallyunderstand the present disclosure. The embodiments shall not beconstrued to limit the present disclosure.

In the following, an imaging method for an image sensor, an imagingapparatus and an electronic device according to embodiments of thepresent disclosure will be described with reference to the drawings.

FIG. 1A is a flow chart showing an imaging method for an image sensoraccording to an embodiment of the present disclosure.

First, the image sensor used in the method of an embodiment of thepresent disclosure will be described.

In detail, the image sensor includes a photosensitive pixel array and afilter disposed on the photosensitive pixel array. The filter includesan array of filter units. The array of filter units includes a pluralityof filter units. Each filter unit and a plurality of adjacentphotosensitive pixels covered by the filter unit in the photosensitivepixel array form a synthesized pixel.

In an embodiment of the present disclosure, four adjacent synthesizedpixels corporately form a synthesized pixel unit. Four filter unitsarranged adjacently within each synthesized pixel unit include a redfilter unit, a blue filter unit and two green filter units.

Referring to FIGS. 2 and 4B, each filter unit 1315 and four adjacentphotosensitive pixels 111 covered by this filter unit 1315 in thephotosensitive pixel array 11 form a synthesized pixel 14. The fouradjacent synthesized pixels form a synthesized pixel unit includingsixteen photosensitive pixels 111.

The four adjacent photosensitive pixels 111 share a filter unit 1315 ofthe same color. For example, the four adjacent photosensitive pixelsGr1, Gr2, Gr3 and Gr4 in a dashed box illustrated in FIG. 2 correspondto the green filter unit 1315. In FIG. 2, Gr, R, B, and Gb areconfigured to indicate colors of the filter units 1315 respectively. Thenumerals 1, 2, 3, 4 are configured to indicate positions of the fouradjacent photosensitive pixels 111 beneath the filter unit 1315. Indetail, R is configured for indicating the red filter unit 1315. B isconfigured for indicating the blue filter unit 1315. Gr and Gb areconfigured for indicating the green filter unit 1315 respectively.

The filter unit 1315 shared by the four adjacent photosensitive pixels111 may be integrally formed, or assembled from four individual filters.Preferably, the filter unit 1315 in this embodiment of the presentdisclosure is integrally formed.

Referring again to FIG. 1A, an imaging method for an image sensoraccording to an embodiment of the present disclosure may includefollowings.

S1, output of the photosensitive pixel array is read, and pixel valuesof photosensitive pixels within different synthesized pixels areextracted from a read-out single-frame high-resolution image and arecombined so as to obtain a plurality of multiple-frame low-resolutionimages.

In an embodiment of the present disclosure, extracting pixel values ofphotosensitive pixels within different synthesized pixels from aread-out single-frame high-resolution image, and combining the pixelvalues so as to obtain a plurality of multiple-frame low-resolutionimages includes: extracting the pixel values of the photosensitivepixels located at same positions in the different synthesized pixelsfrom the read-out single-frame high-resolution image, and combining thepixel values so as to obtain the plurality of multiple-framelow-resolution images.

It is to be understood that, the position where the pixel is extractedfrom the single-frame high-resolution image in an embodiment of thepresent disclosure can also be adjusted according to actual requirementsfor synthesizing images, such as extracting the pixel values of thephotosensitive pixels located at different positions relative to theirrespective synthesized pixels from the read-out single-framehigh-resolution image, and combining the pixel values so as to obtainthe plurality of multiple-frame low-resolution images.

Referring to FIGS. 2 and 4B, the pixel values of the photosensitivepixels 111 located at same positions in the different synthesized pixels14 (four different synthesized pixels) are extracted from thesingle-frame high-resolution image and then are synthesized so as toobtain four frames of low-resolution images. For example, the fourphotosensitive pixels 111 in the first frame of the obtainedlow-resolution images are extracted from the pixel values of thephotosensitive pixels 111 located at the same positions Gr1, R1, B1 andGb1 relative to four respective filter units 1315 included in the fouradjacent synthesized pixels 14.

S2, the plurality of multiple-frame low-resolution images aresynthesized.

In an embodiment, the plurality of multiple-frame low-resolution imagesacquired are synthesized to generate an HDR (High dynamic range) image.

With the imaging method according to an embodiment of the presentdisclosure, an HDR image can be obtained by synthesis as long as thereis one frame output from the image sensor, thereby greatly reducing thetime period for waiting for data frames during the multi-framesynthesis. Moreover, since the data for the multi-frame synthesis comesfrom the same frame output of the image sensor, the generation ofghosting is avoided, thereby greatly enhancing the user experience.

In a specific embodiment of the present disclosure, each filter unittogether with n*n adjacent photosensitive pixels covered by the filterunit in the photosensitive pixel array form a synthesized pixel. Asillustrated in FIG. 1B, the imaging method for an image sensor caninclude followings.

S101, output of the photosensitive pixel array is read, and the pixelvalues of the photosensitive pixels within adjacent synthesized pixelsare extracted from the read-out single-frame high-resolution image andthen are combined so as to obtain at least m frames of low-resolutionimages.

S102, the at least m frames of low-resolution images are synthesized,wherein n is a natural number more than 1, and m is a natural numbermore than 1 and less than or equal to n*n.

In detail, since a synthesized pixel includes n*n photosensitive pixels,at most n*n frames of low-resolution images can be obtained byextracting the pixel values of the photosensitive pixels withindifferent synthesized pixels from the read-out single-framehigh-resolution image, and combining the pixel values. According toactual needs, the at least m frames of low-resolution images can beobtained for multi-frame synthesis.

In a specific embodiment of the present disclosure, each filter unit and2*2 adjacent photosensitive pixels covered by the filter unit in thephotosensitive pixel array form a synthesized pixel. As illustrated inFIG. 1C, the imaging method for an image sensor can include followings.

S201, output of the photosensitive pixel array is read, and the pixelvalues of the photosensitive pixels within different synthesized pixelsare extracted from the read-out single-frame high-resolution image andthen are combined so as to obtain 4 frames of low-resolution images.

S202, the 4 frames of low-resolution images are synthesized.

For example, it is assumed that the frame rate of an image sensor with16M pixels at dark is 8 frames per second. If 4 frames of data are usedfor multi-frame synthesis, then in the multi-frame synthesis of therelated art, 4 frames of data are required to be output by the imagesensor, that is, the time period for waiting for the data frames duringthe multi-frame synthesis is 0.5 seconds; however, in the imaging methodfor an image sensor of embodiments of the present disclosure, only oneframe of data outputted from the image sensor is required, and then theone frame of data can be divided into four 4M images by extracting thepixel values of the photosensitive pixels within different synthesizedpixels from this read-out high-resolution image frame, and by combiningthe pixel values, that is, the time period of waiting for the data frameduring the multi-frame synthesis is only 0.125 s, thereby greatlyreducing the time period of waiting for the data frame during themulti-frame synthesis and giving a user a better camera experience.

In addition, when the four frames of low-resolution images aresynthesized, since these four 4M images are divided from the same frameimage of the image sensor, the difference among the four 4M images issmall, so that the possibility of ghosting effect can be reduced.

It is to be understood that, concerning the structure of the pluralityof photosensitive pixels covered by each filter unit, in addition to thestructure of n*n (for example, 2*2, 3*3, 4*4) photosensitive pixels,there may be the structure of any n*m (n and m are the natural numbersrespectively) photosensitive pixels. Since the number of photosensitivepixels arranged on the photosensitive pixel array is limited, if eachfilter unit covers too many photosensitive pixels, the resolution of thelow-resolution image obtained is limited. For example, when the pixelvalue of the photosensitive pixel array is 16M, if the structure of 2*2photosensitive pixels is used, four low-resolution images each of whichhas the resolution of 4M are obtained, and if the structure of 4*4photosensitive pixels is used, sixteen low-resolution images each ofwhich has the resolution of 1M are obtained. Therefore, the structure of2*2 photosensitive pixels is a better arrangement, which can enhancebrightness and sharpness of the image under the premise of sacrificingless resolution as possible.

In an embodiment of the present disclosure, the image sensor furtherincludes a lens array arranged above the filter units. The lens arrayincludes a plurality of micro-lenses. Each micro-lens arrangedcorresponds to one photosensitive pixel. The lens array converges lightonto photosensitive parts of photosensitive pixels beneath the filter,thereby enhancing the photosensitivity of the photosensitive pixels toimprove the quality of the image.

In order to realize the above embodiments, the present disclosure alsoprovides an imaging apparatus.

FIG. 3 is a block diagram showing an imaging apparatus according to anembodiment of the present disclosure. As illustrated in FIG. 3, theimaging apparatus 100 according to an embodiment of the presentdisclosure includes an image sensor 10 and an image processing module 20connected to the image sensor 10.

Referring to FIGS. 4A and 4B, the image sensor 10 includes aphotosensitive pixel array 11 and a filter 13 arranged on thephotosensitive pixel array 11. The filter 13 includes an array of filterunits 131. The array of filter units 131 includes a plurality of filterunits 1315. Each filter unit 1315 and a plurality of adjacentphotosensitive pixels 111 arranged under the filter unit 1315 form asynthesized pixel 14. In an embodiment of the present disclosure, fouradjacent synthesized pixels 14 corporately form a synthesized pixel unit(not illustrated in the drawings). The plurality of filter units 1315arranged adjacently within each synthesized pixel unit include a redfilter unit 1315, a blue filter unit 1315 and two green filter units1315.

Taking each filter unit 1315 covering the four adjacent photosensitivepixels 111 with the serial numbers 1, 2, 3 and 4 in the photosensitivepixel array 11 as an example, as illustrated in FIG. 4B, each filterunit 1315 and four adjacent photosensitive pixels 111 arranged underthis filter unit 1315 form a synthesized pixel 14. The four adjacentsynthesized pixels 14 corporately form a synthesized pixel unitincluding sixteen photosensitive pixels 111.

The four adjacent photosensitive pixels 111 share a filter unit 1315 ofthe same color. The four adjacent filter units 1315 (including a redfilter unit 1315, a blue filter unit 1315 and two green filter units1315) form a filter structure 1313.

The filter unit 1315 shared by the four adjacent photosensitive pixels111 may be integrally formed or assembled from four separate filters.Preferably, the filter unit 1315 shared by four adjacent photosensitivepixels 111 is integrally formed (referring to FIG. 4B).

The image processing module 20 is configured to read an output of thephotosensitive pixel array 11, and is configured to extract pixel valuesof photosensitive pixels 111 within different synthesized pixels from aread-out single-frame high-resolution image, and combine the pixelvalues so as to obtain a plurality of multiple-frame low-resolutionimages, and is configured to synthesize the plurality of multiple-framelow-resolution images.

In an embodiment of the present disclosure, the image processing module20 is further configured to extract the pixel values of thephotosensitive pixels 111 located at same positions in the differentsynthesized pixels from the read-out single-frame high-resolution image,and is further configured to combine the pixel values so as to obtainthe plurality of multiple-frame low-resolution images.

It is to be understood that, the position where the pixel is extractedfrom the single-frame high-resolution image in an embodiment of thepresent disclosure can also be adjusted according to actual requirementsof the composite image, such as the image processing module 20 extractsthe pixel values of the photosensitive pixels located at differentpositions in the different synthesized pixels from the read-outsingle-frame high-resolution for combination so as to obtain theplurality of multiple-frame low-resolution images.

Referring to FIGS. 2 and 4B, the image processing module 20 extracts thepixel values of the photosensitive pixels 111 located at same positionsin the different synthesized pixels 14 (four different synthesizedpixels including the photosensitive pixels 111) from the single-framehigh-resolution image, and then combines the pixel values so as toobtain 4 frames of low-resolution images. For example, the fourphotosensitive pixels 111 in the first frame of the obtainedlow-resolution images are extracted from the pixel values of thephotosensitive pixels 111 located at same positions Gr1, R1, B1 and Gb1relative to four respective filter units 1315 included in the fouradjacent synthesized pixels 14.

Further, the image processing module 20 is configured to synthesize theplurality of multiple-frame low-resolution images acquired to synthesizean HDR image.

With the imaging apparatus according to an embodiment of the presentdisclosure, the image processing module can obtain an HDR image bysynthesis as long as there is one frame outputted from the image sensor,thereby greatly reducing the time period for waiting for data framesduring the multi-frame synthesis; further since the data for themulti-frame synthesis comes from the same frame of the image sensor, theghosting effect may be avoided, and thus greatly enhancing the userexperience.

In an embodiment of the present disclosure, each filter unit 1315 andn*n adjacent photosensitive pixels 111 covered by the filter unit 1315in the photosensitive pixel array 11 form a synthesized pixel. The imageprocessing module 20 is further configured to: read output of thephotosensitive pixel array 111, extract the pixel values of thephotosensitive pixels 111 within adjacent synthesized pixels from theread-out single-frame high-resolution image, and combine the pixelvalues so as to obtain at least m frames of low-resolution images, andsynthesize the at least m frames of low-resolution images, wherein n isa natural number more than 1, m is a natural number more than 1 and lessthan or equal to n*n.

In an embodiment of the present disclosure, each filter unit 1315 and2*2 adjacent photosensitive pixels 111 covered by the filter unit 1315in the photosensitive pixel array 11 form a synthesized pixel. The imageprocessing module 20 is further configured to: read output of thephotosensitive pixel array 11, extract the pixel values of thephotosensitive pixels 111 within different synthesized pixels from theread-out single-frame high-resolution image, and combine the pixelvalues so as to obtain 4 frames of low-resolution images, and synthesizethe 4 frames of low-resolution images.

For example, it is assumed that the frame rate of a 16M image sensor atdark is 8 frames per second. If 4 frames of data are used formulti-frame synthesis, then in the multi-frame synthesis of the relatedart, 4 frames of data are required to be outputted by the image sensor,that is, the time period for waiting for the data frames during themulti-frame synthesis is 0.5 seconds; however, according to the imagingapparatus in embodiments of the present disclosure, only one frame ofdata outputted from the image sensor is required, and then the imageprocessing module 20 extracts the pixel values of the photosensitivepixels 111 within different synthesized pixels from this frame read-outhigh-resolution image and combines the pixel values, such that the oneframe of data can be divided into four 4M images, that is, the timeperiod of waiting for the data frame during the multi-frame synthesis isonly 0.125 s, thereby greatly reducing the time period of waiting forthe data frame during the multi-frame synthesis and giving a user abetter camera experience.

In addition, when the 4 frames of low-resolution images are synthesized,since four 4M images are divided from the same image frame of the imagesensor, the difference among the four 4M images is small, so that thepossibility of ghosting effect can be reduced.

It is to be understood that, concerning the structure of the pluralityof photosensitive pixels 111 covered by each filter unit 1315, inaddition to the structure of n*n (for example, 2*2, 3*3, 4*4)photosensitive pixels, there may be the structure of any n*m (n and mare the natural numbers respectively) photosensitive pixels. Since thenumber of photosensitive pixels 111 arranged on the photosensitive pixelarray 11 is limited, if each filter unit 1315 covers too manyphotosensitive pixels 111, the resolution of the low-resolution imageobtained is limited. For example, when the pixel value of thephotosensitive pixel array 11 is 16M, if the structure of 2*2photosensitive pixels is used, four low-resolution images each of whichhas the resolution of 4M are obtained, and if the structure of 4*4photosensitive pixels is used, sixteen low-resolution images each ofwhich has the resolution of 1M are obtained. Therefore, the structure of2*2 photosensitive pixels is a better arrangement, which can enhancebrightness and sharpness of the image under the premise of sacrificingless resolution as possible.

Referring to FIG. 4C, in an embodiment of the present disclosure, eachsynthesized pixel 14 of the image sensor 10 further includes a lensarray 15 arranged above the filter units 1315. Each micro-lens 151 inthe lens array 15 corresponds to one photosensitive pixel 111 withregard to shape, size and position. The micro-lens 151 converges lightonto a photosensitive part 112 of the photosensitive pixel 111, therebyenhancing the photosensitivity of the photosensitive pixels 111 toimprove the quality of the image. In some embodiments, each filter unit1315 corresponds to 2*2 photosensitive pixels 111 and 2*2 micro-lenses151.

Referring to FIG. 5, FIG. 5 is a schematic diagram illustrating aphotographic pixel and a related circuit. In an embodiment of thepresent disclosure, the photosensitive pixel 111 includes a photodiode1113. The connection relationships between the photosensitive pixel 111and the switching tube 1115, the source follower 1117 and theanalog-to-digital converter 17 are illustrated in FIG. 5. That is, onephotoreceptor pixel 111 corresponds to one source follower 1117 and oneanalog-to-digital converter 17.

The photodiode 1113 is configured to convert light into electric charge.The generated electric charge is proportional to intensity of the light.The switching tube 1115 is configured to control the circuit to turn onor off according to the control signals of the row selection logic unit41 and the column selection logic unit 43. When the circuit is turnedon, the source follower 1117 is configured to convert the charge signalgenerated by the photodiode 1113 from light illumination into a voltagesignal. The analog-to-digital converter 17 is configured to convert thevoltage signal into a digital signal and to transmit the digital signalto the image processing module 20 for processing. The row selectionlogic unit 41 and the column selection logic unit 43 are connected to acontrol module (not illustrated in the drawings) of the imagingapparatus 100 and are controlled by the control module of the imagingapparatus 100.

With the imaging apparatus according to an embodiment of the presentdisclosure, the image processing module can obtain an HDR image effectby synthetically as long as one frame outputted from the image sensor isobtained, thereby greatly reducing the time period for waiting for dataframes during the multi-frame synthesis; moreover, since the data forthe multi-frame synthesis comes from the same frame of the image sensor,the ghosting effect may be avoided, and thus greatly enhancing the userexperience.

In order to realize the above embodiments, the present disclosure alsoprovides an electronic device. The electronic device includes theimaging apparatus of embodiments of the present disclosure.

With the electronic device according to an embodiment of the presentdisclosure, since the imaging apparatus is provided, when taking photos,an HDR image effect can be obtained by synthesis as long as there is oneframe outputted from the image sensor, thereby greatly reducing the timeperiod for waiting for data frames during the multi-frame synthesis. Inaddition, since the data for the multi-frame synthesis comes from thesame frame of the image sensor, the ghosting effect may be avoided, andthus greatly enhancing the user experience.

In order to realize the above embodiments, the present disclosure alsoprovides a mobile terminal.

Referring to FIG. 6, FIG. 6 is a block diagram of a mobile terminalaccording to an embodiment of the present disclosure.

As illustrated in FIG. 6, the mobile terminal 60 according to anembodiment of the present disclosure includes a housing 601, a processor602, a memory 603, a circuit board 604, a power supply circuit 605 andan image sensor 606. The circuit board 604 is located in a space definedby the housing 601. The processor 602, the memory 603 and the imagesensor 606 are arranged on the circuit board 604. The power supplycircuit 605 is configured to supply power for each circuit or componentin the mobile terminal 60. The image sensor 606 includes aphotosensitive pixel array and a filter disposed on the photosensitivepixel array. The filter includes an array of filter units. Each filterunit and a plurality of adjacent photosensitive pixels covered by thefilter unit in the photosensitive pixel array form a synthesized pixel.The memory 603 is configured to store executable program codes. Theprocessor 602 is configured to execute a program corresponding to theexecutable program codes by reading the executable program codes storedin the memory 603 so as to perform acts of:

reading an output of the photosensitive pixel array, extracting pixelvalues of photosensitive pixels within different synthesized pixels froma read-out single-frame high-resolution image, and combining the pixelvalues so as to obtain a plurality of multiple-frame low-resolutionimages; and

synthesizing the plurality of multiple-frame low-resolution images.

It should be noted that, the foregoing explanation of the imaging methodfor an image sensor according to embodiments is also applicable to themobile terminal in this embodiment, and the implementation thereof aresimilar in principle and will not be described here.

With the mobile terminal of embodiments of the present disclosure, theprocessor is configured to execute the program corresponding to theexecutable program codes by reading the executable program codes storedin the memory so as to perform acts of: reading output of thephotosensitive pixel array, extracting pixel values of photosensitivepixels within different synthesized pixels from a read-out single-framehigh-resolution image and combining the pixel values so as to obtain aplurality of multiple-frame low-resolution images; synthesizing theplurality of multiple-frame low-resolution images. Therefore, an HDRimage can be obtained by synthesis while only one frame output from theimage sensor is needed, thereby greatly reducing the time period forwaiting for data frames during the multi-frame synthesis; moreover,since the data for the multi-frame synthesis comes from the same frameof the image sensor, the generation of ghosting may be avoided, and thusgreatly enhancing the user experience.

In order to realize the above embodiments, the present disclosure alsoprovides a non-transitory computer-readable storage medium having storedtherein one or more programs. When the one or more programs areperformed by a device, the device is caused to perform the imagingmethod for an image sensor according to the first aspect of embodimentsof the present disclosure.

In the description of the present disclosure, it is to be understoodthat, terms such as “center”, “longitudinal”, “lateral”, “length”,“width”, “thickness”, “over”, “below”, “front”, “back”, “left”, “right”,“vertical”, “horizontal”, “top”, “bottom”, “in”, “out”, “clockwise”,“anti-clockwise”, “axial”, “radial” and “circumference” refer to thedirections and location relations which are the directions and locationrelations shown in the drawings, and for describing the presentdisclosure and for describing in simple, and which are not intended toindicate or imply that the device or the elements are disposed to locateat the specific directions or are structured and performed in thespecific directions, which could not to be understood to the limitationof the present disclosure.

In addition, terms such as “first” and “second” are used herein forpurposes of description and are not intended to indicate or implyrelative importance or significance. Furthermore, the feature definedwith “first” and “second” may comprise one or more this featuredistinctly or implicitly. In the description of the present disclosure,“a plurality of” means two or more than two, unless specified otherwise.

In the present disclosure, unless specified or limited otherwise, theterms “mounted,” “connected,” “coupled” and “fixed” are understoodbroadly, such as fixed, detachable mountings, connections and couplingsor integrated, and can be mechanical or electrical mountings,connections and couplings, and also can be direct and via media indirectmountings, connections, and couplings, and further can be innermountings, connections and couplings of two components or interactionrelations between two components, which can be understood by thoseskilled in the art according to the detail embodiment of the presentdisclosure.

In the present disclosure, unless specified or limited otherwise, thefirst characteristic is “on” or “under” the second characteristic refersto the first characteristic and the second characteristic can be director via media indirect mountings, connections, and couplings. And, thefirst characteristic is “on”, “above”, “over” the second characteristicmay refer to the first characteristic is right over the secondcharacteristic or is diagonal above the second characteristic, or justrefer to the horizontal height of the first characteristic is higherthan the horizontal height of the second characteristic. The firstcharacteristic is “below” or “under” the second characteristic may referto the first characteristic is right over the second characteristic oris diagonal under the second characteristic, or just refer to thehorizontal height of the first characteristic is lower than thehorizontal height of the second characteristic.

In the description of the present disclosure, reference throughout thisspecification to “an embodiment,” “some embodiments,” “an example,” “aspecific example,” or “some examples,” means that a particular feature,structure, material, or characteristic described in connection with theembodiment or example is included in at least one embodiment or exampleof the present disclosure. Thus, the appearances of the phrases invarious places throughout this specification are not necessarilyreferring to the same embodiment or example of the present disclosure.Furthermore, the particular features, structures, materials, orcharacteristics may be combined in any suitable manner in one or moreembodiments or examples. Without a contradiction, the differentembodiments or examples and the features of the different embodiments orexamples can be combined by those skilled in the art.

The flow chart or any process or method described herein in othermanners may represent a module, segment, or portion of code thatcomprises one or more executable instructions to implement the specifiedlogic function(s) or that comprises one or more executable instructionsof the steps of the progress. Although the flow chart shows a specificorder of execution, it is understood that the order of execution maydiffer from that which is depicted. For example, the order of executionof two or more boxes may be scrambled relative to the order shown.

The logic and/or step described in other manners herein or shown in theflow chart, for example, a particular sequence table of executableinstructions for realizing the logical function, may be specificallyachieved in any computer readable medium to be used by the instructionexecution system, device or equipment (such as the system based oncomputers, the system comprising processors or other systems capable ofobtaining the instruction from the instruction execution system, deviceand equipment and executing the instruction), or to be used incombination with the instruction execution system, device and equipment.As to the specification, “the computer readable medium” may be anydevice adaptive for including, storing, communicating, propagating ortransferring programs to be used by or in combination with theinstruction execution system, device or equipment. More specificexamples of the computer readable medium comprise but are not limitedto: an electronic connection (an electronic device) with one or morewires, a portable computer enclosure (a magnetic device), a randomaccess memory (RAM), a read only memory (ROM), an erasable programmableread-only memory (EPROM or a flash memory), an optical fiber device anda portable compact disk read-only memory (CDROM). In addition, thecomputer readable medium may even be a paper or other appropriate mediumcapable of printing programs thereon, this is because, for example, thepaper or other appropriate medium may be optically scanned and thenedited, decrypted or processed with other appropriate methods whennecessary to obtain the programs in an electric manner, and then theprograms may be stored in the computer memories.

It should be understood that each part of the present disclosure may berealized by the hardware, software, firmware or their combination. Inthe above embodiments, a plurality of steps or methods may be realizedby the software or firmware stored in the memory and executed by theappropriate instruction execution system. For example, if it is realizedby the hardware, likewise in another embodiment, the steps or methodsmay be realized by one or a combination of the following techniquesknown in the art: a discrete logic circuit having a logic gate circuitfor realizing a logic function of a data signal, an application-specificintegrated circuit having an appropriate combination logic gate circuit,a programmable gate array (PGA), a field programmable gate array (FPGA),etc.

Those skilled in the art shall understand that all or parts of the stepsin the above exemplifying method of the present disclosure may beachieved by commanding the related hardware with programs. The programsmay be stored in a computer readable storage medium, and the programscomprise one or a combination of the steps in the method embodiments ofthe present disclosure when run on a computer.

In addition, each function cell of the embodiments of the presentdisclosure may be integrated in a processing module, or these cells maybe separate physical existence, or two or more cells are integrated in aprocessing module. The integrated module may be realized in a form ofhardware or in a form of software function modules. When the integratedmodule is realized in a form of software function module and is sold orused as a standalone product, the integrated module may be stored in acomputer readable storage medium.

The storage medium mentioned above may be read-only memories, magneticdisks, CD, etc. Although explanatory embodiments have been shown anddescribed, it would be appreciated by those skilled in the art that theabove embodiments cannot be construed to limit the present disclosure,and changes, alternatives, and modifications can be made in theembodiments without departing from spirit, principles and scope of thepresent disclosure.

1. An imaging method for an image sensor, wherein the image sensorcomprises a photosensitive pixel array and a filter arranged on thephotosensitive pixel array, the filter comprises an array of filterunits, each filter unit and a plurality of adjacent photosensitivepixels covered by the filter unit in the photosensitive pixel array forma synthesized pixel, and the method comprising: reading an output of thephotosensitive pixel array, and extracting pixel values ofphotosensitive pixels within different synthesized pixels from aread-out single-frame high-resolution image, and combining the pixelvalues so as to obtain a plurality of multiple-frame low-resolutionimages; and synthesizing the plurality of multiple-frame low-resolutionimages.
 2. The imaging method according to claim 1, wherein extractingpixel values of photosensitive pixels within different synthesizedpixels from a read-out single-frame high-resolution image, and combiningthe pixel values so as to obtain a plurality of multi-framelow-resolution images comprises: from the read-out single-framehigh-resolution image, extracting the pixel values of the photosensitivepixels located at same positions in the different synthesized pixels,and combining the pixel values so as to obtain the plurality ofmulti-frame low-resolution images.
 3. The imaging method according toclaim 1, wherein each filter unit and n*n adjacent photosensitive pixelscovered by the filter unit in the photosensitive pixel array form asynthesized pixel, and the imaging method comprising: reading the outputof the photosensitive pixel array, extracting the pixel values of thephotosensitive pixels within adjacent synthesized pixels from theread-out single-frame high-resolution image, and combining the pixelvalues so as to obtain at least m frames of low-resolution images; andsynthesizing the at least m frames of low-resolution images, wherein nis a natural number greater than 1, m is a natural number greater than 1and less than or equal to n*n.
 4. The imaging method according to claim3, wherein each filter unit and 2*2 adjacent photosensitive pixelscovered by the filter unit in the photosensitive pixel array form asynthesized pixel, and the imaging method comprising: reading the outputof the photosensitive pixel array, and extracting the pixel values ofthe photosensitive pixels within different synthesized pixels from theread-out single-frame high-resolution image, and combining the pixelvalues so as to obtain four frames of the low-resolution images; andsynthesizing the four frames of low-resolution images.
 5. The imagingmethod according to claim 1, wherein four adjacent synthesized pixelscorporately form a synthesized pixel unit, and four filter unitsarranged adjacently within each synthesized pixel unit, comprise a redfilter unit, a blue filter unit and two green filter units.
 6. Animaging apparatus, comprising: an image sensor, comprising: aphotosensitive pixel array; a filter arranged on the photosensitivepixel array, wherein the filter comprises an array of filter units, eachfilter unit and a plurality of adjacent photosensitive pixels covered bythe filter unit in the photosensitive pixel array form a synthesizedpixel; and an image processing module, connected to the image sensor,configured to read an output of the photosensitive pixel array, and toextract pixel values of photosensitive pixels within differentsynthesized pixels from a read-out single-frame high-resolution image,and to combine the pixel values so as to obtain a plurality ofmultiple-frame low-resolution images and to synthesize the plurality ofmultiple-frame low-resolution images.
 7. The imaging apparatus accordingto claim 6, wherein the image processing module is configured to extractthe pixel values of the photosensitive pixels located at same positionsin the different synthesized pixels from the read-out single-framehigh-resolution image, and combine the pixel values so as to obtain theplurality of multiple-frame low-resolution images.
 8. The imagingapparatus according to claim 6, wherein each filter unit and n*nadjacent photosensitive pixels covered by the filter unit in thephotosensitive pixel array form a synthesized pixel, and the imageprocessing module is configured to: read the output of thephotosensitive pixel array, extract the pixel values of thephotosensitive pixels within adjacent synthesized pixels from theread-out single-frame high-resolution image, and combine the pixelvalues so as to obtain at least m frames of low-resolution images; andsynthesize the at least m frames of low-resolution images, wherein n isa natural number greater than 1, m is a natural number greater than 1and less than or equal to n*n.
 9. The imaging apparatus according toclaim 8, wherein each filter unit and 2*2 adjacent photosensitive pixelscovered by the filter unit in the photosensitive pixel array form asynthesized pixel, and the image processing module is configured to:read the output of the photosensitive pixel array, extract e the pixelvalues of the photosensitive pixels within different synthesized pixelsfrom the read-out single-frame high-resolution image, and combine thepixel values so as to obtain four frames of low-resolution images; andsynthesize the four frames of low-resolution images.
 10. The imagingapparatus according to claim 6, wherein four adjacent synthesized pixelscorporately form a synthesized pixel unit, and four filter unitsarranged adjacently within each synthesized pixel unit comprise a redfilter unit, a blue filter unit and two green filter units.
 11. Theimaging apparatus according to claim 6, wherein each synthesized pixelfurther comprises a lens array arranged above the filter unit, and thelens array converges light onto the photosensitive pixels beneath thefilter.
 12. The imaging apparatus according to claim 11, wherein thelens array comprises a plurality of micro-lenses and each micro-lens isarranged corresponding to one photosensitive pixel.
 13. A mobileterminal, comprising: a housing; a processor; a memory; a circuit board;a power supply circuit and an image sensor, wherein the circuit board islocated in a space defined by the housing, the processor, the memory andthe image sensor are disposed on the circuit board; the power supplycircuit is configured to supply power for each circuit or component inthe mobile terminal; the image sensor comprises a photosensitive pixelarray and a filter arranged on the photosensitive pixel array, thefilter comprises an array of filter units, each filter unit and aplurality of adjacent photosensitive pixels covered by the filter unitin the photosensitive pixel array form a synthesized pixel; the memoryis configured to store executable program codes; the processor isconfigured to execute a program corresponding to the executable programcodes by reading the executable program codes stored in the memory so asto perform acts of: reading an output of the photosensitive pixel array,extracting pixel values of photosensitive pixels within differentsynthesized pixels from a read-out single-frame high-resolution image,and combining the pixel values so as to obtain a plurality ofmultiple-frame low-resolution images; and synthesizing the plurality ofmultiple-frame low-resolution images.
 14. The mobile terminal accordingto claim 13, wherein the processor is further configured to: from theread-out single-frame high-resolution image, extract the pixel values ofthe photosensitive pixels located at same positions in the differentsynthesized pixels, and combine the pixel values so as to obtain theplurality of multiple-frame low-resolution images.
 15. The mobileterminal according to claim 13, wherein each filter unit and n*nadjacent photosensitive pixels covered by the filter unit in thephotosensitive pixel array form a synthesized pixel, and the processoris configured to: read the output of the photosensitive pixel array,extract the pixel values of the photosensitive pixels within adjacentsynthesized pixels from the read-out single-frame high-resolution image,and combine the pixel values so as to obtain at least m frames oflow-resolution images; and synthesize the at least m frames oflow-resolution images, wherein n is a natural number greater than 1, mis a natural number greater than 1 and less than or equal to n*n. 16.The mobile terminal according to claim 15, wherein each filter unit and2*2 adjacent photosensitive pixels covered by the filter unit in thephotosensitive pixel array form a synthesized pixel, and the processoris configured to: read the output of the photosensitive pixel array, andextract the pixel values of the photosensitive pixels within differentsynthesized pixels from the read-out single-frame high-resolution image,and combine the pixel values so as to obtain four frames oflow-resolution images; and synthesize the four frames of low-resolutionimages.
 17. The mobile terminal according to claim 13, wherein fouradjacent synthesized pixels form a synthesized pixel unit, and fourfilter units arranged adjacently within each synthesized pixel unitcomprise a red filter unit, a blue filter unit and two green filterunits.
 18. (canceled)
 19. The mobile terminal according to claim 13,wherein each synthesized pixel further comprises a lens array arrangedabove the filter unit, and the lens array is configured to convergelight onto the photosensitive pixels beneath the filter.
 20. The mobileterminal according to claim 19, wherein the lens array comprises aplurality of micro-lenses and each micro-lens is arranged correspondingto one photosensitive pixel.